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CHAPTER  I 


iNTRQDUCTION 

Applied  Paychological  Services  has  carried  out  a  series  of  stud  ' 
les  which  liave  had  as  one  important  purpose  the  develq^mc  at  of  criteric  n 
measures  for  the  post-training  performance  evaluation  oi  enlisted  per¬ 
sonnel  in  various  Naval  aviati^m  ratings.  The  research  has  progressed 
along  a  line  of  thinking  which  first  produce  i  Technical  Behavior  Oieck 
Lists  (TBCLs)  for  four  ratings  <Ilichlin«  Pederman.  and  Si^sgel.  19S8; 
Siegel.  Richlin.  and  Federman.  10S8;  Siegel.  Richlin.  and  Federaoan. 
I860:  Richlin,  Si^el.  and  Schnlts.  1080).  The  TBCLs  were  compre¬ 
hensive.  detailed  Uets  of  the  tasks  performsd  by  men  in  each  ratine. 
Psychological  scaling  techniques  were  then  used  in  a  series  of  inves¬ 
tigations  into  their  applicsbiUty  to  a  eklU  hierarchy.  Applicattoo  of 
the  scaling  techniques  led  to  the  conetruction  of  short,  convenient-to- 
use,  post-training  performance  evaluative  instruments  for  each  of  two 
Naval  ratings  (Siegel  end  Benson.  1059;  Siegel.  Schults.  and  Benson. 

1860).  The  next  Ic^cal  question  to  ask  was  whether  a  abort,  scaled 
fleet  performance  measurement  device  could  be  developed  which  could 
be  general  enough  to  be  used  scross  several  ratinga.  The  research 
descrlbinl  in  this  report  wee  designed  to  answer  that  question. 
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The  Scaling  Methods 

The  scallug  approaches  employed  in  the  two  previout<  scaling 
stiidiea  (Siegel  and  Benstm.  195P;  Siegel  at  (3l.,1960)  were  these  proposed 
by  Thurstme  (1929)  and  by  Quttman  (1950).  These  methods  were  orig- 
malty  devel(^>ed  primarily  for  the  measurement  of  pi^hoi^ysical  |^e- 
nomena  and  attitudes.  One  conclusion  from  the  two  studies  by  Siegel 
and  his  associates  was  that  skills  are  scalable  in  the  sanm  manner  as 
attittides  and  the  sensory  phenomena  which  have  been  previcaely  scaled 
psychophyeically. 

The  underlying  rationale  and  application  of  the  techniques  to  the 
skill  domain  were  discussed  in  die  two  previous  reports.  Thuretone's 
requirements  for  a  set  etetements  or  items  to  be  considered  a  scale 
were  that: 


1.  the  set  of  statements  should  all  relate  to  the 
same  psychological  object 

2.  the  items  slmuld  fall  along  a  conttnuum  from 
’least”  to  ”moat” 

3.  the  point  at  which  each  statement  falls  alm^  the 
continuum  should  be  definable 

4.  the  prt^whiUty  dietxibution  of  eodoreement  of 
the  scale  values  of  the  statements  should  be 
normal  and  variance  minimal 


Quttman  considered  a  set  of  items  to  form  a  scale  pi*ovided; 


1.  a  person  who  obtains  a  hlj^r  rank  than  a  second 
person  on  e  given  item  is  also  as  high  or  tiigher 
<m  all  other  items  (reproducibility) 
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2.  tile  nonfittln^  responses  are  well  scatte  cd  and 
distributed  randomly;  clustering  would  ndlcate 
a  systematic  distortion  of  the  scale  pattern 
(pattern  of  errors) 

3.  no  or  only  a  fee;'  items  have  almost  all :  esponses 
lua]|>ed  under  a  single  alternative.  For  example, 
an  item  answered  positively  by  95  per  cent  oi  the 
respondents  could  not  possess  a  reproducibility  of 
less  than  95  per  cent,  while  an  item  po 'sessing  a 
50-50  split  could  theoretically  result  in  50  per  cent 
nonfitting  re^mises  (range  of  marginal  distribution) 


The  Thitrstone  method  has  been  de^oibed  by  Torgerson  as  typical 
of  the  "stimulus-centered  or  judgment  approach"  to  scaling  in  which  '’the 
syfidematic  variation  in  the  reactimis  of  the  subjects  to  the  stimuli  is  at¬ 
tributed  to  differences  in  the  stimuli  with  respect  to  a  designated  attribute" 
(10S8,  p.  46).  The  Quttman  technique,  on  the  other  hand,  is  taken  a^s  an 
example  of  the  "re^Mmse  approach"  in  which  ^Variability  at  raactiMis  to 
stimuli  is  ascribed  to  both  variation  in  the  subjects  and  ir>  the  stimuli" 
(1958,  p.  46).  Both  methods,  however,  assume  an  underlying  paycho» 
l(gical  continuum  along  which  stimuli  may  be  ordered. 

Need  for  a  Generalised  Scaled  Oieck  List 

Siegel  and  Bensem  (1658)  demonstrated  the  scalabiLlity,  in  both 
the  Thurstune  and  Guttman  senses,  of  the  skills  involved  in  the  Naval 
specialty  of  aviation  electronics  technician.  Si^elet  e(<lL>60)  achieved 
similar  results  for  the  sMlls  involved  in  the  Naval  specialty  of  aviation 
machinist's  mate. 


-  3  - 


Although  the  check  lists  developed  in  these  studi  es  were  of  v.iiue 
for  the  post-training  eval'uation  of  technicians  in  s  partzculsr  rsUng,  it 
Sj^enred  that  a  short,  scaled  check  list  which  w<mld  ap^dy  to  several 
ratings  would  have  wider  significance,  even  greater  use  fal'iess,  ami  would 
also  be  of  considerable  interest  from  ^e  standpoint  scaling  theory.  Not 
only  would  such  an  instrument  alloiw  a  more  ecoomnicai  means  of  measur¬ 
ing  post-trsinii^  fleet  performance  with  a  *r.inlmum  of  uifferent  forms, 
but  the  establishment  of  a  common  scaled  hierarchy  would  also  pro¬ 
vide  a  kind  of  comoum  base  across  related  ratings.  This  base  would  have 
implicatloos  for  cross-rating  evaluations,  job  task  analysis,  career  plan¬ 
ning,  the  establishment  of  tninlng  requirements  acroer  ratiags.  etc. . 
and  possibly  mli^t  give  some  basis  for  grouping  across  ratings  for  var¬ 
ious  purposes.  In  ottisr  words,  it  might  provide  a  com  non  taxonomy 
for  describing  relsted  i*atlngs.  Additionally,  since  there  is  a  constant 
need  for  sound,  short  Job  oriented  instrumente  for  the  evaluation  of  fleet 
performance  in  order  to  provide  feetflMhck  to  training  facilltlas,  it  seemed 
to  be  a  worthwhile  effort  to  try  to  develop  the  broader-baaad  acalad  check 
lists. 

Purposes  of  the  Preset  Study 

The  primary  purpose  of  ttte  present  study,  therefore,  wee  to  in¬ 
vestigate  whether  technical  proficiency  criterion  measurement  instru¬ 
ments  ccmld  be  conetructed  which  could  be  applied  acro»  s  several  reieted 
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Naval  I'atings  (specialties)  and  which  could  be  scaled  acroia  these  rat¬ 
ings  by  both  the  H-.urstone  and  Guttman  techniques.  Achie  ing  this  pur 
pose  embraced  two  steps:  (1)  developing  behaviorally  based  items  that 
were  generad  enough  toai^ly  to  the  skills  included  in  the  several  ratings 
and  yet  covered  the  important  duties  of  each  rating,  and  (2)  scaling  the 
items  over  the  several  ratings. 

SectMuiary  purposes  of  tho  study  were  to  establish  die  relationship 
of  the  derived  instruments  to  other  pertinent  available  meesurea  and  to 
determine  the  predictability  of  die  ntm  inatr*:meota  from  th  jse  measures. 

Ratings  Invoived 

Electronics  was  selected  as  the  brosd  area  within  which  the  r9> 
search  would  focus.  The  following  five  Naval  ratings  were  felt  to  involve 
skills  of  various  related  types  within  electronics: 

[1]  aviation  electricUn'a  mats  (AB) 

[2]  aviation  electronics  technician  (AT) 

[3]  aviation  fire  cmitrol  technician  (AQ) 

[4]  aviation  guided  mlaelleman  (OF) 

[5]  TRADBVMAN  (Traiiiii«  Devices  Man)  (TD) 

It  was  soon  determined  that  there  were  very  few  Avisdoe  Ooided 
Missilemen  availsble  for  study.  Accordingly,  this  rating  was  dropfMd 
and  the  etudy  was  based  on  the  remaining  four  ratings. 
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CHAPTER  U 


DEVEU>PME*'iT  OP  A  GENERAL  SCALE  FOR  ELECTRC>?«IC  TECHNICAL 
SKILLS  3Y  THE  THURSTONE  ]^UAL-APPEARlNO  INTiaRVAL  METHOD 

Deveicyment  of  Prelimlrmry  Task  List 

Hie  poaelblUty  of  cootnictiQg  a  gmeralised  technical  sklU  check 
list  that  would  scale  rested  Hrst  of  all  upon  eeolYiaf  an  appropriate  list  oi 
the  tasks  performed  in  the  several  ratims  and  caatinf  dieae  tasks  in  &  form 
that  would  have  essentially  equivalent  meaning  tor  all  of  tl^e  four  ratings  in¬ 
cluded.  To  be  useful,  the  list  had  to  include  um  tasks  which  accounted  for 
the  major  electronic  activities  of  each  rating  in  a  form  that  would  result  in 
their  being  common  to  die  four  ratiiq{a. 

Ihe  previous  studies  of  Naval  technicians  cited  in  Chapter  1  gave 
the  investigators  considerabte  insight  into  the  kinds  of  work  done  by  var¬ 
ious  kinds  of  Naval  technicians  in  electronically  oriented  ^>ecialties.  llie 
TBCLs  which  had  been  developed  served  as  sources  of  specific  si^ges- 
tions.  Consultations  were  also  held  with  staff  members  of  the  Mmd  Air 
Technical  Training  Command.  Out  of  this  background  a  list  ot  2f  tasks 
was  prepared.  The  form  of  the  items  was  to  present  only  the  basic  func¬ 
tion  in  each  task,  such  as  "operates**  or  "calibrates,"  without  r^erence 
to  any  specific  equipment.  The  general  directions  for  die  list  stated 
that  each  item  was  to  be  interpreted  as  a  substitutioo  in  die  sentence 
"A  striker  orpetty  officer  third  class  in  the  rate 

equipment  which  is  erMompaased  by  the  rate.  *' 
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The  list  of  28  tasks  was  submitted  to  a  total  of  28  i.istructors  ai 
the  Naval  A*t  Terhnical  Training  Command  who  had  squadron  esperience 
in  either  the  AE,  AT,  AQ,  or  TD  ratings.  Thej  ws»*e  ask  to  indicate 
in  which  areas  technicians  in  their  rating  worked.  After  tlie  instructors 
had  given  their  judgments,  they  were  interviewed  as  to  their  feelings 
about  the  list  and  for  unlisted  work  srees.  In  general,  the  inatructors 
fotmd  the  lista  complete  and  the  terminology  acceptable.  Although  they 
had  a  few  suggeatitms  to  clear  up  minor  co.ifusli^  poAnta,  &  mnjority  of 
these  experienced  men  agreed  that  21  of  the  28  taaka  were  done  to  stmie 
degree  by  strikers  or  petty  officers  third  class  in  their  rating.  Several 
of  the  instructors  thmight  that  each  at  the  other  seven  taake  were  aleo 
worked  on  but  that  diese  aeven  taaka  were  performed  in  the  ratinga  by 
the  higher  level  perammel.  Accordingly,  pending  farther  Enalyala,  all 
28  tasks  were  left  in  the  initial,  experimental  Uat. 

The  Preliminary  Task  LAat 

The  28  tasks  which  had  been  developed  and  checked  with  experi¬ 
enced  Instructors  were  put  in  a  preliminary  form.  In  this  form  the 
respondent  was  presented  with  sn  eleven  point  contUiuum  si«d  asked  to 
indicate  where  on  the  continuum  each  task  would  fall  in  difficulty  for 
the  average  striker.  He  wee  told  diat  number  t  on  the  continuum  was 
to  represent  die  task  that  is  Issst  difficult  for  ths  average  striker.  ** 
Number  7  was  to  repressnt  *'the  Job  that  is  ths  '*m<Mt  difficult"  for  ths 
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typical  striker.  The  intermediate  numbers  were  to  re;  resent  inter 
mi.diate  degrees  of  difficulty.  The  respondents  were  provided  with 
g-ommed.  prentunbered  response  labels  in  amounts  such  that  the  fre¬ 
quency  distribution  of  the  numbers  printed  on  the  stickers  roughly  sp’ 
proximated  a  normal  dl«tributi<m.  The  specific  frequency  distribution 
of  the  gummed  labels  is  presented  in  Tsble  1.  The  respondent  wss 
asked  to  pliute  one  of  the  labels  next  to  e v  h  listed  task 


Tsble  1 


Frequency  Distribution  of  Oummsd  Rsapoose  Lsbsls 
for  Prsliminary  Task  Liat 


Nundbar  Providad 


The  instructitma  for  die  preliminary  task  list  are  given  in 
Tsble  2.  The  complete  form,  as  uasd,  is  pressnMd  as  Appendix  A 
to  thio  report. 
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Table  2 


Directiona  for  Preliminary  Taab  Llat 

Listed  below  you  will  find  38  tasks  that  are  d<MM  by  strikers  in 
your  rating.  Read  over  the  28  tasks  and  then  uaiiHI  the  scale  boloiw  as 
a  gtiide  indicate  the  degree  of  dlfnculty  you  believe  tiiat  the  typical  striker 
encounters  on  each  of  the  tasks  before  he  can  perform  it  proficiently. 
These  Ju<%ments  are  to  be  made  in  the  foUowinf  manner: 


VtST  CASV  SMOMC  MMlWr  VtT?  MfriCNtf 

or  sirrisukfv 

1.  Usiflf  the  stickers  providsd  place  the  stfcksr  with  a  on  it  nest 
to  die  Job  that  is  least  difficult  for  the  average  atrihsr. 

3.  Then  pick  the  three  Jobs  that  fkll  in  category  "two**  and  pet  the 
three  stickera  with  3'a  on  them  next  to  theeo  itonui. 

Now  find  the  Jo>  that  ia  the  most  difficult  and  placs  ths  sticker 
witii  ths  ^  on  it  nsst  to  this  itsm. 

Find  ths  thrss  itsms  you  want  to  pises  ia  cstsgory  "six*'  and  put 
tltoss  stlcksrs  Dsxt  to  fiisss  thrss  itsms. 

Now  with  dis  tasks  rsmstning  pises  thsm  ia  thsir  propsr  catsgory 
by  putting  ths  sticksr  (i.  s. .  4.  or  5)  with  the  catsgory  numhsr 

nsxt  to  ths  itsms.  ” 


5. 


In  previoua  studies  (Siegel  and  Benson,  1859;  Si  Schulti; 
and  Benson  188ft)  two  other  response  forms  had  been  u  ed.  one  askiiig 
for  the  number  of  checkouts  required  bjr  the  typical  striker  before  h<  is 
able  to  do  the  task  without  direct  supervision  and  the  other  calling  for  the 
amount  of  inservice  training  required  before  the  typical  striker  can  per¬ 
form  the  task  prol^ciently.  The  analysis  of  the  data  in  those  two  studies 
supported  the  conclusitm  that  essentially  the  same  scale  hierarchy 
established  by  the  various  questltm  forms.  Thsrsfors,  in  ths  present 
atudy,  only  the  difficulty  form  was  used  at  this  first  stei>. 

The  28  items  or  tasks  inclitdsd  in  ths  prsUminsr^  task  list  were; 


1.  Operating 

2.  PrsfUfht  in^>ectiiig 

3.  PostfUgfat  iaspsctlnc 

4.  bllight  inspsctinf 

5.  Periodically  injecting 


0.  Maintaining 

7.  Removing 

8.  Repsiring 
8.  Replnclng 

10.  Performing  prsvsntstlvs  mslntsnancs 

11.  Trouble  shooting /I solsting  mnlftsMtionls)  in 

12.  Calibrsting 


13.  Aligning 

14.  Following  block  diagrams  for 

15.  Using  standard  schematics  for 

16.  Analjrslng  standard  circuitry  in 

17.  Employing  safety  precautions  on 

18.  Using  pn^r  safety  precautions  for  self  v<.hen 
working  on 

19.  Making  out  failure  r^ozia  for 

20.  Using  manuals  of  a  technical,  nature  for 

21.  Using  appropriate  test  equipment  for  determiaiag 
malfunction  in  the 

22.  Using  ASO  catalogue  for  replacement  parts  for 

23.  Using  mathematical  formulas  necessary  far  solr> 
lag  circuit  eqMtiooa  for 

24.  En^Jcyiag  eteeironio  principles  inrsteed  n  main- 
teasace  ci 

25.  Knowing  relatimiship  of  equipment  to  other  related 
28.  Instructing  others  in  operatioo  of 

27.  Instructing  oUiers  in  maintenance  of 

28.  Instructing  others  in  the  injq>ection  of 

Sample 

The  preliminary  task  list  was  administered  to  242  aidisted  super¬ 
visory  perstmnel  in  the  ratings  and  pay  grades  described  in  Table  2  and  in 
the  sqtiadrons  and  locatims  listed  in  Table  4. 
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Table  3 


Numbera  of  Supervisors  in  Sample  by  Rating  and  Pay  Gra  :le 


Fbrtv  Ctfficcr 
S*c<ad  Claas  (2/'c) 

0 

Total 

Aviation  Electrician's  Mate  (AE)  26 

21 

21 

68 

Aviation  Electronics  Technician  (AT)  28 

24 

28 

80 

Aviation  Fire  Control  Technician  (AQ)  3 

22 

13 

44 

TRADEVMAN  (TD)  14 

19 

17 

50 

TOTAL  71 

86 

88 

242 

Included  in  the  CPO  grot^  were  17  Master  Chiefs  and  2  i 

onlor  Chiefs 

Table  4 

Wumbra  of  SupTviaora  in  Sac  pU  by  Loction  and  Sgiiadi-on 


Locatiwi 

Squadrob 

Nomber 

CecU  Field 

PABTULANT 

1 

FASRON  9 

22 

PlTRCHf  14 

2 

VA  48 

7 

VP  11 

10 

VP  14 

7 

VF  174 

17 

VFP  62 

11 

JackstmvlUe 

ABWRON  4 

1 

VA  44 

26 

VAP  82 

7 

VP  18 

14 

VW4 

21 

Norfolk 

FAETULANl* 

25 

FASRON  3 

4 

FASRON  102 

3 

VR  22 

S 

VRF  31 

2 

Quonset  Point 

FAETULANT  DBT.  3 

14 

Suiford 

FASRON  51 

3 

VAH  3 

14 

VAH  8 

8 

VAH  7 

13 

VAH  11 

2 

242 

Administration 


The  preliminary  task  list  was  administered  to  grot^  j  of  Big>er- 
vlsors  at  each  base.  A  full  explanation  of  the  purpose  of  the  study  and 
instructions  oa  how  to  use  the  gummed  labels  were  given  to  the  ratere 
before  the  preliminary  taak  list  waa  distributad.  The  mpe^  vlsora  were 
asked  to  complete  a  Sailor's  Haval  Attitude  (SKA)  Imrmitory  after  ttiey 
completed  tte  preliminary  tank  list. 

Each  groig>  aession  took  approodmatt  ly  one  hour. 


Results 

Usi^  the  response  data  obtained  from  the  administt  atiou  of  the 
preliminary  task  list  to  the  342  supervisors,  ths  msdian  an  i  interqiuartlie 
rasge  were  calculated  for  each  item  (or  task).  Thsse  providsd  the  oesle  (S) 
end  devisUen  (())  values  nsedsd  for  sstshUshing  a  scale  aecordtog  to 
Thurstone'a  method  of  oqiMLl-^ppeariQg  intervale.  The  results  are  plotted 
in  Figure  1.  In  examining  this  figure,  it  should  be  remen^ered  that  the 
rater  was  forced  to  respond  on  a  seven  point  scale  and  to  normalise  ap¬ 
proximately  the  dietrUratioo  of  hie  responses.  Ths  lowest  emesis  value 
was  i.  S3  for  item  7  ("removing*^  sad  tiM  hlgheet  was  t.  06  tor 
item  11  CHrouble  rtiooting/isolating  maltonctiociia)  in'*).  Widle  fliia  ie  a 
good  ral^p»  of  S  values,  the  very  extreme  positioas  are  not  rspraaaatsd, 
a  finding  consisteot  with  the  previous  two  stadiM.  Ths  Q  values  are 
fairly  ctmstant  over  the  entire  range  of  8  valaes,  with  perh^a  a  alight 
suggeetion  ttiet  they  are  higher  for  the  more  dilHceit  tasks. 
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Item  Selection  for  a  Thurstone  Type  Scale 

In  order  to  select  a  subset  of  items  (tasks)  which  wf^old  form  a 
Thurstone  ^ual>a{^aring  interval  scale,  items  were  sought  which  wouid: 

1.  r^resezit  all  values  aloi^  tlM  psjrclKklaglcal 
"difllcultj''  continuum  (scatteiinf  of  S  values) 

2.  have  minimum  Q  values 

3.  sample  all  technical  areas  performed  in  tue 
ratini^a  involved 

Since  it  was  hoped  that  two  parallel  scales  could  be  ^oostmeted, 
two  sets  of  items  were  selected.  Because  of  the  ai^e  itet^  avalise 
at  the  extxwmes  of  the  S  value  distribution,  it  was  necessary  to  accept 
three  items  ("removii^,  **  "rapladstf .  **  and  '*lro«d>le  abootir>f /isolatlag 
malfuactioo(s)  in'*)  for  bodi  seta,  thus  introducinf  common  <^lomMts 
into  maj  scores  based  on  dieee  ecalee. 

The  selected  tasks  for  the  two  scales,  with  tbelr  S  end  Q  values, 
are  presented  in  Table  5.  The  froupe  of  selected  tasks  are  also  ledlca^ 
in  Figure  1.  These  data  confirm  dis  conelusloos  of  dm  prc;4oas  two  stud¬ 
ies  that  sktUs  are  scalable  in  dm  same  manaar  as  attitudmi  and  dm  aansory 
phenomena  which  bava  bean  pravioualF  scalad  pa7cbaph]raic£ll3r.  Bara, 
moreover,  a  ain^  seals  was  darlvad  whicli  was  applicable  to  a  fituB  oi 
four  different  but  r^ted  Navel  alectronioa  ratiafa,  rather  than  to  Just  e 
sizzle  ratify. 


CHAPTER  UI 


GUTTMAN  TYPE  SCALE  ANALYSIS  OF 
TECHNICAL  SKILLS  CHECK  LISTS 

The  Guttman  method  for  ecalinc  items  has  bem  disciissed  in 
detail  la  the  two  previous  Applied  Psychological  Services'  reports  of 
research  in  skUl  scaling  (Siegel  and  Benson*  1989;  Si^el  at., 
10£O).  *1120  second  of  Hiese  summarises  Outtman's  basi  s  approach  as 

follows: 


'If  a  single  psychological  variable  msSerlies 
die  re^Ases  to  a  set  of  items,  then  it  should  be 
possible  to  order  individuals  on  this  variable  by 
the  hierarchy  of  rei^>onses  to  the  items.  Con¬ 
versely,  to  the  extent  that  a  hierarchy  is  pre«;ent, 
to  ttiat  extent  may  an  underlying  Qatent)  singla 
dinMnsion be  assumed"  (Siegelst  at..  I960,  p. 21). 


In  using  the  technique,  one  seeks  an  order  or  hiorar^qr  in  the 
given  set  of  items  such  that  each  individual's  overall  rsidi  is  directly 
riilftied  to  the  hi|^st  item  in  the  set  which  he  endorses  or  passes.  If 
such  an  orv  jr  cm  be  found,  the  set  of  items  is  said  to  scale  and  to 
measvxe  a  single  latent  diraensioo. 


Evaluation  Form 


In  order  to  establish  scalability  in  the  Outtman  cmse.  the  28  tasim 
included  in  the  previously  described  preliminary  task  list  were  put  in  a 
form  which  would  allow  for  evaluations  oi  individuals  rvther  than  taeks. 


The  directions  for  this  form  differed  from  those  of  the  preli  linar/  tAsk 
in  two  respects:  (1)  tiwy  were  orients  in  terms  of  s  st  ifle  man 
whom  the  rater  had  st^rvised  rather  than  the  en>era^  strtk  r.  and  (2) 
they  asked  whether  the  man  being  rated  is  chmckmd  out  on  the  task  ra^er 

than  how  difficult  the  task  is  for  the  typical  striker. 

The  response  alternatives  available  to  the  rater  for  each  task  for 
eau^h  tLan  evaluated  were: 

1.  Has  worked  <m  task  end  le  checked  out 

2.  Hea  worked  on  teek  end  is  not  checked  oat 

3.  Hee  not  worked  on  teek 

The  full  inetructlone  ere  preeented  in  Table  d.  The  complete 
form  conetltutee  Appendix  B  of  diie  report. 


Table  6 


2 

{ 

I 

I 

I  DirectifKie  for  Evaluation  Form 

■  «  ■  INI  IIW  — iiW— — i— — — 

For  each  of  the  taska  listed  indicate  (by  placing  a  ch^ek  mark  in 
the  appropriate  column)  whether  or  not  the  man  you  are  evaJuating  has 
been  checked  out  as  being  proficient  (i.  e. ,  is  be  capable  of  doii^  the 
task  "on  his  own"  without  direct  supervision?)  If  the  man  you  are  rafing 
has  not  been  checked  out  as  being  proficient  o*  a  task  becaui^e  he  has  not 
worked  (xi  this  task,  this  should  be  indicated  b^  a  check  mai  k  in  the  third 
column. 

Saamplea; 

1.  If  the  man  has  been  checked  out  on  a  task  place  a  check  mark  (/) 
in  column  one  (1). 

2.  If  ho  has  not  been  checked  out  as  being  proficiset  but  ias  actually 
worked  va  t^ka  task  place  a  check  mark  (/)  in  columr  two  (1). 

3.  If  he  has  nM  been  checked  out  as  being  pndicieat  bee  4uae  he  haa 
not  performed  this  teak,  place  a  check  mark  (/i  in  column 
three  (3)  next  to  the  appropriate  item. 

Be  sure  t!aet  you  give  an  answer  for  every  teak  that  llated.  Tou 
may  not  be  certain  about  some  items,  but  answer  every  item  on  the  basic 
of  ^hat  appears  to  be  the  most  nearly  correct  answer  for  the  man  you  are 

rating. 

Sample 

A  total  of  181  technicians  wers  svalustsd  through  this  form.  The 
technicians  were  distributed  in  the  ratings  and  pay  gradss  ahusm  In  Ta* 
ble  7  and  in  ths  squadrons  and  locaticms  sfmwn  in  Table  8. 
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Table  7 


l^usibgrs  of  ‘T’acliaiciama  in  Sagnplo  by  Ratia|{  awl  Pay  ^  rade 


Aviation  Electrician's  Mate  (AE)  10 
Avlaticn  Electronics  Technician  (AT)  16 
viation  Fire  Control  Technician  (AQ)  10 
EADEVMAN  (TD)  7 

TOTAL  43 


iteiiffirs/c)  ^8Eir'<  /c)  (i/=.  t«oi 


38 

- 

- 

48 

35 

- 

- 

51 

22 

7 

3 

41 

33 

10 

1 

41 

118 

17 

3 

181 

Table  8 


KmaJaera  of  Techniciane  to  Sample  by  t^^ation  and  Sqv  r^dron 


Location 

Sduadrm 

Htaadlter 

CecU  Field 

PAETULANT 

1 

PASBON9 

n 

nmON  14 

1 

VA48 

3 

VF  11 

6 

VF  14 

•  8 

VF  174 

12 

VFP  82 

4 

Jacksonville 

ASWaON  4 

3 

VA  44 

21 

VAP  62 

7 

VP  18 

18 

VW  4 

8 

Norfolk 

FASTULANT 

5 

FA3RON  3 

3 

FASRON  102 

2 

VR  33 

3 

VRF  31 

1 

Quofiset  Point 

FARTVLANT  DBT.  3 

Sanford 

FASiK>N  51 

a 

VAH  3 

13 

VAH  5 

3 

VAH  7 

3 

Itii 
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Ad  mini  stration 


This  fora,  was  administered  to  the  same  st4>er\  Isors  in  gro-wps 
as  ihe  prelimlxsai^  task  list.  The  si^rvisozy  personfu'i  were  desci’ibed 
in  Tables  3  ami  4.  Each  rater  was  asked  to  evaltmte  a  techalcian  he  bad 
suj^ervised;  the  technician  was  not  necessarily  ttie  bem  or  ttie  poorest 
man  be  had  had  tmder  him. 

Analytic  Method 

An  in  the  two  earlier  scaling  stndls«,  the  methei  oi  noalogram 
aoalyais  proposed  by  Oreen  <1056)  was  enpiogred.  Thii^  analytic  me1liod« 
an  extenalon  of  Guttman'a  techniqoa,  places  emphasis  m  a  aingla  statistic, 
the  index  of  cmisicten^,  1.  in  place  of  die  several  reqtirements  for  ecal- 
abUity  proposed  by  Outtmaa.  1  relates  the  obtained  rej  rodneShility  Cwhich 
Green  computes  from  summary  statistics)  to  that  sxpectsd  by  ehaac  a.  Re 
suggests  that  I  should  be  .  SO  or  greater,  if  the  set  of  it^ma  la  to  be  con¬ 
sidered  a  scale  in  the  Guttman  sense.  Green  writes: 

'*This  critsrioa  appears  to  glvs  roughly  eom- 
pju-akbls  rssults  to  tbe  many  criteria  hacd  beretofww 
and  will  be  belpfbl  to  those  who  desire  to  create  a 
dichotomy  of  acalee  os.  nonncalsa''  USS3,  p.  S7}. 

It  should  bs  recognised,  however,  that  Green's  selsctica  of  a  apaciuc 
vmlus  of  I  for  tbs  brash  betwssn  acalsa  and  uonscalss  ir  an  arbltrar;,^ 
matter.  la  general,  ths  hi^sr  ths  I.  tbs  grsatsr  die  c  j^dence  that 
can  be  plMsd  in  the  ecalebility  of  the  item  eet. 


One  problem  was  whether  to  attempt  to  scale  the  it.  ns  for  the 
technicians  in  each  of  the  four  ratings  separately  or  to  woi  with  the 
data  from  «U  four  groups  combined. 

£stid}il8hing  the  scalability  of  an  item  set  over  tiie  :.our  ratings 
Esparately  would  not  thereby  establish  its  scalability  over  he  total  frorp. 
Gultm&ii  writes: 

"A  universe  may  not  forn)  a  seals  for  ths  total 
populati(m«  but  still  form  a  «oalo  for  aubfrc  ipa  of 
that  population"  <1950.  p.  89). 

This  is  termed  the  "relativity"  of  scales  and  &mhinan  argues  that: 

"Scales  are  relative  both  to  time  and  to  popula¬ 
tions"  <1950.  p.  188). 

However,  it  did  seem  reasonable  to  b^in  with  an  analyaia  of  the 
entire  sample  since  a  finding  of  jcalsbility  at  that  level  woidd  lead  to  th  j 
conclusion  dist  the  item  set  also  scaled  within  eKh  rating  4;roup.  On 
this  point  Quttman  states; 

"...  if  a  scale  ia  obtained  for  a  cross  sectlori  the 
population,  then  that  same  scale  patteni  necoaaarily 
holds  for  sU  major  subgrotg>s"  <1850.  p.  89). 

Therefore,  in  the  present  study,  the  enslynfs  first  treated  ‘  he  response 
data  from  all  four  ratings  taken  together,  with  the  thought  niAt  if  scal^il- 
ity  was  rmt  estsbllshed  at  that  Isvel.  ths  snslysls  would  proceed  to 
various  combliwUons  €tf  three  or  two  ratings. 
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The  items  or  tusks  to  be  tested  for  Guttman  scalabil;  .  /  were 
those  iQ:riuded  in  Sealed  List  A  <10  items)  ami  Scaled  List  B  id  items) 
which  had  been  selected  as  described  in  Chapter  n  because  they  formed 
Thurstone  equal>8{^earizig  interval  scales.  Guttman  has  not  provided 
any  methc^  for  the  preliminary  selection  and  ordering  of  a  set  of  items. 
hi  this  study,  as  in  the  ps'cvious  two,  this  was  accompliihed  by  using 
the  Ttiurstone  analysis  as  a  first  step  in  the  CKittman  analyitfe. 

Since  Orel’s  method  requires  dichotomous  scoring,  ihs  ''not 
checked  out"  and  "not  worked  on"  categories  jt  the  sraluatioD  form  were 
considered  equivalent,  as  opposed  to  the  "checked  out"  rsq>0£:se. 

Results 

When  the  re^xmses  to  the  10  items  of  the  Thurstone  Scaled  List  A 
were  subjected  to  a  Chtttman  analysis,  a  rsproducibility  figure  of  .  903 
and  an  I  of  .  434  ware  obtained.  Since  the  X  value  did  not  reach  Oreen'a 
critical  level  of  .  90,  the  Mxt  st^  waa  to  ctmaldsr  dropping  fr  om  the 
analysis  the  technicians  of  <me  of  the  ratings.  Rsvisw  of  tbs  data  sug¬ 
gested  that  the  re^Mosea  of  the  THADEVMAff  differed  from  bte  re^Mmsee 
cf  the  other  three  ratings  more  ^sa  those  of  the  ttiree  did  from  one  anoth¬ 
er.  But  the  1  obtained  without  the  TRADEVlfEN,  although  higher,  was 
only  .  459. 

Sim;e  it  sesmsd  apparent  that  the  disturbing  influsnce  was  in  the 
Items  rather  than  in  the  ssmpls,  ths  nsjtt  st^  was  to  drop  soma  anom¬ 
alous  itsms.  Thera  is  soma  dlsagrssmsnt  shout  ths  wisdom  or  this  pro¬ 
cedure.  Green,  for  exsn^le,  writes; 
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"if  a  eet  of  items  does  not  scale,  the  posait  uty 
esists  of  rejecting  one  or  two  poor  items,  s:  d  then 
achieving  a  scale.  Chittman  is  chary  of  this  pro¬ 
cedure,  preferring  to  say  that  the  universe  .  3  not 
scalable.  However,  it  seems  possible  to  h&ve 
perfectly  good  items  with  the  wreutg  form  for  the 
Guttooan  scale.  To  this  author,  the  pMSibil  ty  of 
rejecting  items  seems  t6  be  a  necessary  pat  i  of 
any  method  of  (attitude)*  mMSursmsnt  (1954, 
p.  357). 


Torgersoa  takes  the  same  point  of  view  as  Orssn.  lie  says: 


". . .  further  way  to  increase  'ocolsbillly*  is  t>im|»ly 
to  discard  or  revise  the  offendi.ig  items.  WMls 
Guttman  in  general  frowns  on  biis  procedure  it 
would  seem  to  be  necessary  in  many  cases”  11859, 
p.  330). 


Tasks  3  (*^>ostfli^  hd^tecUng”),  4  (“inflfght  mspecUng”),  and 
28  Constructing  others  in  the  inspection  of*')  were  eliminated  from  Sealed 
List  A  and  the  remaining  seven  items  analysed.  The  rssul  s  are  shown 
in  Table  9.  The  dtKained  X  of  .  580  is  high  enough  to  conclude  that  the 
seven  items  involved  form  a  scale  in  the  Guttman  sense.  Tlisss  seven 
items  are  henceforth  referred  to  as  the  Scaled  Technical  Pr  oficisney 
Check  List,  Form  A  (STPCL  A). 


*  parentheses  ours 
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Table  9 


Results  of  Scalability  Analyia  of  A 

Eeproducibility  (Rep.  )  .  34S 

Reproducibility  expected  by  chance  (Rep.  1)  .  863 

Index  of  conaietency  (I)  .  S80 

The  results  from  the  Guttman  analysis  of  Rm  eight  ilema  in  the 
Thurstone  Scaled  List  B  are  presented  in  TaL'ie  10.  The  I  ot .  540  in* 
dicates  that  these  items  also  constitute  a  Out^  jnaa  scale.  I  hMe  eight 
items  are  henceforth  referred  to  as  toe  Scaletl  Technical  F?x>ficieiicy 
Check  List.Porm  B  (STPCL  B). 


Table  10 

Results  of  Scalability  Analysis  of  STPCL  B 
R^roducibility  (Rep. )  .  038 

Reproducibility  expected  by  chance  (R^.  I)  .  858 
Index  <d  ccmsistency  (I)  .  540 

The  value  of  1  for  STPCL  A  is  probably  inflated  to  some  extent  by 
the  fact  that,  in  deciding  upon  which  items  to  drop,  the  response  ssatrix 
was  examixMd  and,  therefore,  some  advantage  was  talmi  of  chance  rela~ 
Ucmships  in  toe  data.  Although  1  for  STPCL  A  should  be  checked  in  another 
populatltm  sample  to  determine  its  value  more  accurately,  the  fact  that 
STPCL  B,  from  which  no  items  were  elimluated,  scaled  w^juld  street 
that  the  I  given  above  for  List  A  ie  not  e  groee  overeetimat^on. 
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Discussion 


The  fact  that  it  was  possible  in  the  present  study  to  establish 
scales  over  four  related  but  different  Naval  ratings  has  several  signif¬ 
icant  implications.  It  is  apparently  possible  to  generalize  a  funcUcKi  by 
divorcing  it  from  specific  equipment  and  still  retain  its  meaningfulness 
in  different  sltoaUcms.  This  was  the  central  problem  faced  in  wriUn^^ 
the  itemc  or  task  descripticMis.  ?*hat  it  is  posalbls  to  Sf  ale  these  items 
means  that  ^e  technicians  in  the  several  rating's  involved  are  all  doing 
the  gmaeral.  basic  tasks  in  tbe  same  order  (a»  Judged  by  the  ranking  in 
terms  of  tssk  proficiency)  end  diet  if  they  are  checked  cut  on  one  task 
<m  a  scaled  Uat.  it  can  be  assumed  thst  they  are  proflcient  on  the  tasks 
which  are  ranked  below  that  ooa  on  tha  list.  This  woa!d  ssem  to  bs  of 
value  in  underetanding  die  basic  structurs  of  ths  four  rattngs  and  the 
interrelstiociships  among  thsm  and  to  hsvs  significance  Cor  the  develop¬ 
ment  of  training  prt^rams.  Such  a  hierarchy  also  ssems  to  bs  value 
for  describing  the  work  performed  by  the  men  in  the  ratings,  the  sequence 
of  technical  development,  and  for  rating  strueturallintion. 

The  taeks  in  die  STPCL.  Forms  A  and  B.  may  be  arrapgad  in 
three  groigis  in  terms  of  ths  proportion  of  technicians  who  were  proficient 
on  diem.  On  acme  of  these  tasks  were  less  than  of  die  men  dmeked  oat. 
Therefore,  eesignment  to  e  group  may  be  said  to  dspeiKl  on  whsdwr  75 
to  100%.  SO  to  75%.  or  35  to  50%  of  the  tsdhniclsns  wer^’  dsscribsd  as 
being  clMcked  out.  Tables  11  and  13  show  the  percentage  of  etrikerd 
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triEt  could  perform  eacn  of  the  tasks  in  Scaled  TcchiUoal  1  roliciency 
Ciicck  Lists  A  and  B.  In  view  of  the  findings  of  the  carli;  c  stales  thu  t 
judgments  regarding  inservice  training  r^ulred  and  task  llfficuity  were 
found  to  rank  in  the  same  order  as  judgments  regarding  p  coficiency ,  i  i 
would  seem  reaacmable  to  say  tiiat  the  tasks  in  the  75-iOC%  are 

those  which  are  easiest  and  require  the  leas*  Inservice  training,  while 
those  in  the  25>S0%  group  are  those  which  are  most  dlfficxilt  snd  require 
the  most  inservice  trsining. 

In  several  earlier  studies  (Richlln  st  at. .  1958;  Slegsl  si  at. . 
1938;  Si^el  et  at.. 1980;  Richlin  st  at..  1990)  ths  critsr;on  instrument 
was  a  Technical  B^mvior  Check  List  (TBCL).  This  wss  a  comprshsn- 
sive  list  of  all  ths  tasks  performed  in  a  rating.  Ths  TB<;L  score  wss  an 
evaluation  of  how  well,  on  die  avsrags.  ths  technician  was  psrformii^ 
those  tasks  on  which  he  bed  hsd  sn  opportunity  to  work,  if  he  had  done 
oidy  a  few  tasks  but  performed  them  well,  he  obtained  a  high  score.  If 
he  had  done  many  tasks  but  all  of  dism  less  well,  be  obhdnsd  a  lower 
score.  In  evaloatii^  an  individual  TBCL  score,  the  sco^  lag  mediod  em- 
plcyed  must  be  considered.  For  example,  s  man  of  limited  ability  m^ 
be  restricted  to  working  cm  s  few  rather  simple  tasks  which  hs  quickly 
learns  to  do.  On  the  o*her  hand,  a  very  competent  man  nay  he  called 
to  work  on  mafqr  tasks  st  all  levels  difficulty.  ae:p:ie  of  which 
may  requirs  considerable  practice  before  a  man  can  accompileh  them 
*'on  his  own.  "  Provided  this  espect  it  kept  in  mind,  the  TBCL  Is  eff«  c  - 
tlve  in  assaying  how  well  a  technician  haa  done  hie  work 


'Die  sealed  technical  proficiency  check  lists,  ci;  the  other  h:.  ;d, 
evaluate  the  overall  status  of  the  technician  with  refere  ace  to  all  the 
tasks  normally  performed  by  men  of  equivalent  pay  grade  and  rating 
These  lists  contain  only  a  relatively  small  number  of  items  so  that  tiiey 
can  be  quickly  and  easily  completed.  But  the  scales  are  so  construc  ted 
that  the  score  obtained  from  them  can  be  generalized  in  meaning  to  the 
"universe"  of  tasks  of  which  they  are  representative.  Thus,  the  STPCL, 
Forms  A  and  B,  Identify  where  the  technicisr.  stands  relative  to  ^ioal 
developmental  prt^resa  within  his  rating  and  in  related  ratings. 

The  TBCL  should  prove  to  be  valuable  for  providing  molecular 
information  on  how  well  technical  school  graduates  are  performing  as 
a  group  and  thus  aid  In  the  evaluation  of  the  effectivenees  of  training 
programs.  Each  task  In  the  comprehenelve  liet  can  be  checked  from 
the  standpoint  of  the  proficiency  of  graduates  on  that  ^ccific  aspect 
of  tl'.e  job.  When  this  information  is  tied  in  with  the  training,  it  ehoUd 
provide  a  sound  basis  for  recommendations  regarding  changes  in  the 
emphasis  placed  on  various  parts  of  the  training  program. 

The  STPCL  also  has  value  for  training  evaluation  purposes. 

The  data  from  the  selected  items  which  constitute  the  STPCL  may  be 
examined  to  determine  what  proportion  of  the  group  is  checked  out  on 
these  particular  tasks;  changes  in  training  may  then  be  :  ecoromendeiS 
where  greater  or  lees  emphasis  is  desired  in  the  fleet  Also,  whan 
an  experienced  technician  in  one  rating  is  being  retrsim  1  in  another 
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related  specialty.  »U8  score  on  the  STPCL  which  has  been  scaled  over 
several  ratings  sho^ild  suggest  the  approximate  level  at  which  the  re¬ 
training  should  commence.  The  validity  of  this  use  of  the  STPCL  de¬ 
pends  upon  the  gene  rail  sability  and  transferability  of  the  sidlls  involved. 

The  two  types  of  instruments,  therefore,  measure  somewhat 
different  of  jo^  performance  and  serve  different  p'axpoaes.  In 

the  atody  by  Richlin  st  at-.  (1960).  it  waa  found  that  the  ccrrelation  be¬ 
tween  the  two  kinds  of  measures,  as  developer  ^or  aviation  slectronica 
technicians,  waa  positive  but  low;  yet  both  typ.a  of  acoraa  had  roughly 
equivalent  correlations  with  "A”  school  grader. 

One  advantage  of  the  scaled  liata  ia  that  they  are  simple  and 
cemvenient  to  use.  Also,  the  availability  of  two  aealad  liats  may  be  help  ' 
ful  in  certain  situations  such  as  reevaluationa  within  a  short  period  of 
time,  although  it  must  always  be  borne  in  mind  that  there  ia  some  iden¬ 
tity  ot  content  between  the  two  lists.  They  may,  however,  be  considered 
as  rotighly  equivalent  or  parallel  forma. 
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CHAPTER  I V 


INTERRELATl  ONSMIPS  AND  PREDI CTI  ON 
OF  TECHNICAL  FLEET  PERPORMANCI3 

I  ntercorrel>H<m« 

When  any  new  measurement  inatniment  is  developed,  it  is  of 
interest  to  learn  how  its  scores  relate  to  other  known  mefisures.  Such 
information  is  ttssful  in  Judfing  die  theoretical  significance  and  practical 
value  of  the  new  instrument.  In  order  to  det».*mine  some  relatioortiips  of 
this  kind  for  the  two  Scaled  Technical  Proficiency  Check  Uat  forms,  scores 
on  several  other  relevant  variablea  were  obtained  for  the  teehniciaas  who 
were  evaluated  by  tbeir  eupervieora. 

The  final  class  avaraga  (FCA)  attainad  in  "A**  8ebo<d  was  procured 
for  each  man.  Scores  from  the  following  Navy  Basic  Teat  Battery  aptitude 
teats  were  eleo  available: 

Oeneral  Claaalfication  Test  (OCT) 

Arithmetic  Test  (ABl) 

Mscbsnlcal  Test  (MECH) 

Clericsl  Tsst  (CLER) 

In  addition,  a  Sailor's  Naval  AtUtuda  fSNA)  Invantory  was  admin¬ 
istered  to  each  tachnician  who  was  avaluatad.  Tba  SNA  Inventory  is  a 
self- report  inventory  frtiich  meaeurea  the  aallor'a  perception  of  certain 
J<d>  aapacta  purportad  to  be  important  to  industrial  anplt^re#  motivation. 

Its  development,  content,  and  cbaraetaristlcs  have  been  fully  daecribed 
in  another  report  (Siegel  end  Schulte.  ISfO).  In  addition  to  a  total  score. 


the  inventory  yields  part  scores  in  each  of  the  following  five  areas 


Intrinsic  Jdb  Satisfaction  (1);  including  those  ssti^* 
faction  aspects  which  are  derived  from  direct  performance 
of  the  work  itself  and  which  would  tend  to  be  constant  for 
the  job  no  matter  where  the  work  is  performed 

Styeryisory  Relati<mid>ips  (S);  including  the  relations  that 
eidst  t>etween  the  worker  and  his  immediate  supervisor 

Social  Aspects  of  the  Job  (SA);  including  those  Jdb  aspects 
invMvi^  in  the  relationshii^of  a  sailor  with  other  sailors, 
eqieclally  those  of  conc^iaiable  rating; 

C^>port<miW  for  Advancement  (O);  including  those  Joid  as- 
pMts  whira  tbe  i^vidwl  sees  as  poliintial  aources  of 
bettering  his  economic  position,  organisational  etatv-s.  or 
professional  experience 

Extrinsic  Aspects  of  the  Job  (X);  This  score  includei»: 

(a)  working  conditionst  the  sailor's  reactiGr  a 
to  the  ^ysical  a^>Mts  of  the  working  en  • 
vironment  which  are  not  necessarily  part 
of  the  work 

(b)  benefits;  the  sailor's  reactioos  to  tlu>se 
pbases  ot  the  service  which  attempt  to 
protect  him  against  such  emergencies  as 
illness  or  old  age 

<c)  wages;  die  sailor's  reactions  to  his  pay 

(d)  security;  the  sailor's  reactions  to  those 
features  of  die  service  which  lead  to  cor^- 
Unued  employment  and/or  to  vocational 
opportunity  on  leaving  the  service. 
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The  Intercorrelationa  among  all  these  variables,  alca  g  with  means 
and  atai^lard  deviations,  are  presented  in  Table  13.  Hie  N  ior  Table  13 
was  reduced  to  104  because  of  cases  for  whom  only  a  part  of  the  data  was 
available.  This  table  is  identical  to  Table  19  on  page  38  of  the  report  hy 
Si^el  and  Schults  (1980).  It  is  presented  here  again  because  the  two 
ScaliKl  Technical  Proficiencj  CSieck  List  forms  were  only  an  incidental 
pai*t  of  diSt  report,  and  it  seems  •forthwhile  to  eaamlna  the  table  here 
from  stsw^lnt  of  the  correlatioos  involvii‘.g  those  forms,  i.  e. .  the 
correlations  in  the  last  two  rows  of  Tsbls  IS.  Commsnts  on  the  remainder 
of  the  table  will  not  be  repeated. 

The  first  six  eostBcisnts  in  saeh  of  ttw  last  two  rows  of  Table  IS 
reflect  the  relatiooahip  between  the  aeveral  SNA  Inventory  aeores  and  the 
two  acaled  Uata.  Out  ct  twelve  coafflcianta,  aeven  are  statisitleally  aignif* 
least  at  the  5%  level  of  confidence,  althoegh  all  aeven  are  only  between 
.  20  and  .  SO.  The  SNA  Inventory  acorea  that  prodnea  thaaa  c  ignificant 
ccrrelationa  are  Intrlnaic  Job  Satiafactioo,  Soperviaory  Balstjonahipa, 
Extrinsic  Aspects  of  the  Job,  snd  total  score  on  mil  the  parti . 

The  correlation  coefOclanta  between  the  two  acaled  Ixsta  and  tha 
four  ^liasic  batteiy"  test  scores  vary  around  and  ara  cloaa  yj  saro.  The 
correlations  betwesn  FCA  snd  ths  lists  srs  low  and  not  stalir#ticaUy  sig- 
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The  two  scaled  lists  have  a  high  intercorrelation,  whit  reflects 
to  some  extent  the  effect  of  the  three  tasks  common  to  the  two  iiats.  As 
an  approsimate  ai»i  somewhat  inflated  estimate  of  the  'VaraUel  form" 
reliabilit/  of  the  STPCL  forms,  this  value  of  .  89  suggests  thay  Ih^  may 
possess  satisfactory  reliability. 

In  summary,  it  appears  that  job  proficiency  as  measured  by  the 
Scaleti  Technical  Proficiency  Check  List  muy  be  slightly  related  to  some 
job  attitudes  but  that  proficiency  ia  not  relat*vi  to  aptitude  teet  scores  or, 
to  any  aigniflcant  d^ree,  to  "A"  school  grar^ss.  This  finding  for  die  Navy 
parallels  that  of  Thorndike  and  Hagen  (1959)  vdao  found  aptitude  tests  to 
be  useful  for  selecting  occupations!  memberships  but  not  for  predictii^t 
success  ytthtn  sn  occupstioosl  clsssiflcstloQ. 

Prediction  of  Technicsl  Fleet  Performaacs 

In  order  to  determine  hoar  well  on*the>job  technicsl  profictsney 
could  be  predicted  from  die  varisblee  Invoedgated  in  this  study,  ssversl 
multiple  correlation  coefficients  were  computed  from  the  regrcaaloos  of 
STPCL.  Form  B.  ecorea  on  various  combinations  of  predictor c.  The 
simplest  and  most  efficient  group  of  predictive  variables  consisted  of 
the  Intrinsic  J<d>  Ssdsfscdon  (I)  and  Supervisory  Rslatlonships  CS)  scores 
of  the  Sailor's  Naval  Attitude  (SNA)  Inventory  and  the  Arithmetic  Teet 
(AfiH)  of  the  Navy  Basic  Test  Battsry.  Ths  mulUpls  rsgrsssiori  aquation 
in  raw  score  form  which  resulted  from  this  combination  wsst 
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Y  ^  .OeiXi  .  129X2  +  .074X3  -  1.3<0 
where  Y  =  STPCL»  Form  B,  score 

Xj  »  Intrinsic  Job  Satisfaction  (I)  score 
X2  ”  Siqiervisory  Relatiociiships  (S)  score 
X3  ”  Arithmetic  Test  (ARI)  score 

Use  of  the  weij^ts  given  in  the  above  equation  re&olted  in  a  miutipl'^ 
corrti^lation  of  ,  35  between  STPCLt  B  and  the  three  predictors.  This  indi¬ 
cates  that  STPCL  B  scores  can  be  predicted  from  these  variables  with  cmlj 
a  cuMierate  d^pree  of  accuracy.  In  fact,  the  lutrinaic  Jba  Satisfaction 
score  alone  tmd  a  correlation  of  .  39  with  the  scaled  list  (s  cores;  thus,  die 
addition  of  the  other  two  vaHahlea  increased  the  correlation  only  slightly. 

Obviously,  none  ci  the  factore  includad  In  this  atvi^  predictsd  job 
proBclency,  as  maaaured  by  the  two  f«aled  check  liet  for  ms.  with  an^^ 
high  degree  of  effectiveneea.  If  the  check  Uata  are  accepicU  as  instru¬ 
ments  m«nsuriQg  slgniflcsnt  j<d>  bshavior.  new  predictor e  ehonld  be  ui> 
covered  in  the  future.  It  may  be.  for  example,  that  particular  aacticms 
or  certain  aspects  of  the  pre-fleet  technical  training  have  a  direct  bar¬ 
ing  OT  fleet  effectiveness,  even  though  the  overall  school  grades  do  not. 

Chi  the  other  hand,  attitudee  ami  drives  may  play  a  greater  part  on  the 
Job  than  in  school  grades  (or  tbs  sttitudss  snd  drives  which  ere  important 
for  success  in  school  may  be  different  from  those  which  are  Important 
for  success  mi  the  Job).  This  possibility  is  auggMted  the  fact  that 


the  SNA  Liventory  scores  had  higher  correlations  (TabI  13)  with  tht 
Scaled  Technical  Proficiency  Check  List  than  with  "A"  :  chool  grades. 

If  this  is  true,  perhaps  other  personal  characteristics  c  >uld  be  iden 
tified  which  would  be  highly  related  to  job  proficiency,  la  any  caae, 
additional  variables  should  be  investlgaied  for  purposes  of  predictioa 
of  on-the-j<^  technical  proficietK:y  in  the  electr<Hiica  raiinga  studied. 

Compariaona  Among  Ratii^a  anu  Pay  Grades* 

As  a  check  on  the  reaaonableneaa  of  the  STPCL  t' cores,  mesits 
and  standard  deviaUona  were  computed  s^wratelj  for  tha  vartous  ratiofs 
and  pay  grades  represented  amoQg  the  men  evaluated  by  their  supervisors 
in  this  study.  Analyses  of  variance  were  aleo  carried  oist  amoof  ratinge 
and  amcHig  pay  grades  on  each  of  the  STPCL  forme.  The  reeulte  ere 
presented  in  Tables  14-17. 
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Table  14 


Means,  Staiuiard  Deviations,  and  Analj^is  of  Variant  ^  Results 
for  Four  Ratings  on  Scaled  Technical  Proficiency  Civ^ck  List, 

Form  A,  Scores 


Rating* 

N 

Mean 

StaiKiard 

Deviatiaa 

AE 

48 

5.02 

1.67 

AQ 

32 

4  01 

l.il 

AT 

81  . 

5.00 

i.e2 

TD 

30 

8.27 

2.  S5 

•  Strikers 

and  Petly  Officers  Third  dass  only 

Source 

ss 

ms 

1.  Between  ratings 

3 

72. 82 

24.  ii 

2.  Within  rating e 

187 

803.87 

8. 84 

3.  Total 

160 

875.80 

- 

F  •  8.  28 

P<.01 

-  Si 


Table  15 


Means,  Standard  Hevlationa,  and  Analysis  of  Variance  M  sialts 
for  Four  Ratings  on  Scaled  Tecimical  ProficietM^y  Oieck  List. 

Form  B,  Scores 

Standard 


Eating^ 

Mean 

Deriatica 

AS 

48 

5. 17 

1.75 

AQ 

32 

5.41 

1.86 

AT 

51 

;  'll 

2. 10 

TD 

30 

C.83 

2. 37 

*  Strikers  and  Petty  Officers  Third  Class  only 


Soorce 

ss 

ms 

1.  Between  ratiogs 

3 

101.42 

32.81 

2.  Within  ratltws 

157 

828.05 

4.01 

3.  Total 

180 

730.47 

- 

F  •  8.43 

P<.01 

.  )f  . 


Table  16 


Means,  Standard  Deviations,  and  Analysis  of  Variance  l^esults 


for  Three  Pay  Grades  <m  Scaled  Technical  Proficiency  Ch 

Form  A.  Scores 

Dck  List, 

Pay  Grade 

Mean 

Standard 

Devlaticii 

2/c 

17 

6.00 

1.49 

3/c 

118 

4.90 

3.06 

AN  (Striker) 

43 

-.03 

1.81 

Source 

df 

ss 

ms 

MM 

1.  Between  pay  grades 

3 

51.55 

35.78 

2.  Within  pay  grades 

175 

689. 76 

3.94 

3.  Total 

177 

741.31 

. 

F  »  6.54 


P  <  .05 


Table  17 


Means,  Standai^  Deviations.  aiKi  Analysis  of  Variarcce  Re  sults 
for  Three  Pay  Grades  on  Scaled  Tecbnical  Proficiency  Che  k  List, 


Form  B.  Scores 


Pay  Grade 

>v 

Mean 

Standard 

Deviation 

2/c 

17 

6.82 

1.50 

3/c 

118 

8.43 

2. 15 

AN  (Striker) 

43 

4.  44 

1.88 

Source 

SB 

ms 

1 .  Between  pay  grades 

2 

73.07 

38. 54 

2.  Within  |Mty  grades 

178 

738. 03 

4. 22 

3.  Total 

177 

811.10 

• 

P  •  8. 6«  P  <  .  01 
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The  analyses  nf  variance  findings  included  in  Table  j  14  and  15 
Indicate  that  the  means  among  the  strikers  and  petty  office  ra  third  class 
in  the  four  ratii^fa  vary  more  than  would  be  expected  by  chance  alone. 

The  TDs  are  also  more  variable  in  job  proficiency  at  thin  their  group  limn 
are  the  ATs,  AEs,  and  AQe.  Examination  of  the  tables  rt  veals  that  tl^^ 

AT.  AE.  and  AQ  means  are  all  very  similar,  but  that  tbe  TD  mean  is  ^ijout 
a  standard  deviation  lower  than  die  other  diree  This  supt:%orts  die  conclu- 
8i<m  that  the  average  TD  is  less  proficient  than  the  averag  e  sailor  in  th8 
other  three  ratings  in  the  basic  tasks  common  tr  tbs  four  ratlags.  This 
concluBlon  is  partfeularly  interssdag  in  vlsw  of  esrllsr  fto  lings  CBlsgel  and 
Schultx.  1960)  that,  on  the  averege.  TRADBVlfSN  have  mvre  '*favorable'' 
job  attitudee  than  ATa.  AEa.  and  AQe;  although  the  job  aec  ms  to  be  more 
eatieiying  for  the  TDs.  they  sppssr  to  bs  loss  capabis  In  tli  s  basic  shilla 
called  for  in  tbe  rating.  There  are  s  nundber  of  possible  e  qilanatioiis  for 
thie  eituetim.  For  exannple.  TDs  m^  be  called  upon  to  dc  e  greater 
varicfty  ot  taeke,  many  of  which  are  not  common  to  the  electronice  grour^ 
and.  dierefore.  even  though  their  overall  proficieiicy  ia  hlfli.  thoy  are 
not  ee  proflclcnt  ee  the  other  three  ratinge  on  the  electronice  taeka  as 
such.  Or.  it  ie  poeeible  that  electrocdca  work  on  traiidag  cievieem  ia 
baeically  different  in  certain  recpects  from  similar  work  on  aircraft. 
Whatever  the  explanation,  the  findings  baeed  on  8TPCL  ecc  rws  appear 
to  he  <|uite  definite. 


Tables  Ifi  and  17  show  that  the  means  of  the  men  in  the  pay  grades 
of  striker,  petty  officer  third  class,  and  petty  o^cer  accord  class,  also 
vary  more  than  would  be  expected  by  chance.  Since  a  sailer's  pay  grmdn 
reflects  his  level  of  aptitude,  traiaiog,  experience,  knowle  Jges,  skills 
and  responsibilities,  his  ability  to  do  die  basic  tasks  cS  his  rstinf  could 
be  expected  generally  to  increase  as  he  rises  la  ptygrade.  This  rise  ic 
rcflectt^  in  the  data  of  Tables  16  and  17;  ths  xr.creass  in  avarsgs  STPCL 
scores  from  striker  to  petty  officer  third  class  la  approodmatsly  half  a 
standard  devlatiao  and  is  about  the  same  from  petty  officer  third  class 
to  petty  officer  seoor^  class. 

The  results  of  ths  comparisons  smoqg  ratUifs  and  f  my  grades 
appear  to  be  reaeonable  and  so  lend  jMnne  atgiport  to  the  soondnees  of  dte 
STPCL  as  s  criterion  lastnunent. 


CHAPTER  V 


SUMMARY  AND  COWCLIffiiOWS 

Somassfy 

Th9  reaearcb  described  in  this  report  is  <mm  part  a  series  of 
studies  direct«i  toward  the  drveli^meat  of  oo-die-Job  criter;^a  for  the 
pcHst-trainifif  performaoce  evaloatitm  of  «aliste<*  personal  iii  several 
Naval  aviation  raUng s.  For  the  purpose  ot  prooucij^i  criteria  which  would 
reflect  the  developmental  stage  or  level  of  the  Neval  techniclaa,  Siegel  arid 
Benson  (1659)  and  ttegel  et  at.,  (1960)  scaled,  hr/  two  technics,  the  alolla 
involved  ia  two  separate  Naval  aviation  ratings.  The  puiptHi^  of  the  prec  • 
ent  study  was  to  develop  similar  scel^  task  check  lists  whicli  could  be  aip<> 
plied  across  several  related  ratings.  It  was  felt  that  criterion  instnunents 
of  this  kind  would  be  eaiy  end  economical  to  use,  would  demimstrate  a  wi^y 
of  keqpii^  the  number  of  different  fornui  to  a  minimum,  and  vould  have 
implications  for  cross** rating  evaluations  and  actioos. 

The  following  four  Naval  ratings  were  selected  for  stilly  because 
they  involved  skills  in  ths  brosd  srss  oi  slectronicst 

evisti<m  slectriciaa*s  mats  (AS) 
aviation  alectronics  tachntcisn  (AT) 
svlstion  fire  control  technicisn  {M0 
TRAOSVilAN  (TD) 
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A3  in  the  two  previous  scaled  check  list  sttadiea,  i  0  scaling 
methods  described  by  Thurstone  (1929}  and  OKittman  (195CI  were  used. 
First,  a  comprehensive  list  of  the  hisks  performed  in  the  /our  ratlins 
was  devel(^}ed  and  submitted  for  criticism  and  sutfestimi  to  a  group 
of  inatructora  mho  had  squadron  eaperiesce  in  die  ratlngc-  The  re¬ 
vised  list  was  then  administered  to  enlisted  supervisory  p  ^raoimal.  with 
instructions  to  estimate  the  degree  of  dlfflcui^  of  each  task  for  the  aver¬ 
age  atrlker  In  the  ratlQg.  Tbeae  reaponsas  formed  the  baaia  for  die  atial- 
ysla  by  the  Thurstoae  method.  Utllialng  dm  results  of  thio  first  phase 
the  study  ss  groundwork,  the  siqiervisory  evalnstions  of  a  group  of  tech¬ 
nicians.  In  terms  of  whsther  tfas  man  was  chscksd  out  on  each  task;  wcrs 
then  analysed  by  the  Quitman  technique. 

l%a  relatiooidiips  betwemi  post-truinlng  performance  proAciency 
and  several  other  relevant  variables.  Including  Naval  states,  wars  also 
investigstad.  In  addlti<m.  pradlctlon  ot  Job  proficiency  wa.^  studied  by  a 
multiple  regreasiem  analyaia. 

For  tha  scailiy  invesdgationa.  man  from  all  four  t  «tinga  ware 
treated  as  mie  conqKMite.  Two  roqghly  parallel  data  of  U  i  and  sight 
selected  tasks  were  found  to  scale  from  the  atandpoial  of  ti  e  Thurstone 
sUuularda.  The  eight-item  check  list  alao  acalad  according  to  Qraan'a 
(1959)  criterimi  for  the  eatabUahmeot  ot  a  Outtmaa  typo  ot  seals.  The 
other  list  met  Orem's  critarlon  only  aftar  thraa  tasks  wer^  dalatad. 


"I'hii  two  Guttman  scaled  check  lists  were  found  to  have  a  i  gh  inter¬ 
relationship  due  partly  to  the  presence  of  three  items,  at  he  extremes 
of  the  continuum,  common  to  both  lists. 

Several  scores  from  a  self-report  job  attitude  inve  ntory  were 
found  to  have  slight  positive  correlations  with  job  proficie icy  as  meas¬ 
ured  by  the  two  forms  of  the  Scaled  Technical  Proficiency  Check  List 
(STPCD.  However,  no  statistically  significant  correlaticiis  were  fouci 
between  the  check  lists  and  either  scores  fron.  the  Navy  Basic  Test  Battery 
or  school  grades.  A  multiple  regression  equation  wa  j  derived  which 
produced  a  weighted  combination  of  two  attitudlnal  subtest  scores  and  cne 
aptitude  teat.  The  weighted  sum  had  a  correlation  d  .  S6  with  8TPCL, 

Form  B. 

ComparlB<ms  on  STPCL  scores  snaong  the  four  ratings  rspre- 
sented  in  the  stddecta  revsaied  that  the  TRADBVlfBN  attained  mean 
scores  signilicutly  lower  than  the  AEs,  AQs,  and  ATs.  liiis  contrasted 
with  an  earlier  finding  (Sl^el  and  Schults,  19S0)  that  TRADEVICBN  ha^ 
generally  more  favorable  job  attitudes.  There  was  a  regu  ar  increase 
in  STPCL  scores  from  striker  through  petty  officer  third  class  to  petty 


officer  second  class. 


|>jaciaiiior.s 


The  following  concluoionf.  seem  jiistified  by  the  results,  of  the 
research  described  in  this  report; 


1.  Skiils  icnrolved  in  the  Nsval  reiiiiM  of  nviati^  i 
eloctricUm's  mate,  svistioo  electroaies  tech " 
nlcisn.  arelsticm  lire  control  techniciaii,  end 
TRADBVMAN  are  scaled  by  both  tiie  Thnrstene 
method  of  eqaal-appearii^  iatenrals  sad  the 
Quttman  method  of  acalogram  analysis. 

2.  It  is  possible  to  coastmet  t.  tingle  scaled  teeh- 
nlcal  prdlcieacy  cheek  liat  *vitiidi  oaa  be  apf  .lied 
to  techaioiaae  in  aqy  of  four  electroaies  rsli:’ifs. 

3.  As  awsssred  by  tbe  Sesisd  Tecbaieal  Froflcimiey 
Cheek  LAet.  TKAOWMBIf  aro  algidflctantly  leaa 
proflcieat  oa  tbe  eieetronioa  tanks  oosaaMa  to  all 
four  ratings  tfaui  seiation  alactrieiaa'a  auicjit 
aelatUm  electroaiea  tachaicians,  aad  8vfatio{>  fire 
eoatrol  techniciaas. 

4.  As  rslleeted  by  ths  scaled  liste.  tte  prolleieney 
of  electronically  oriented  terhniciana  oa  the  tanks 
done  in  their  rating s  risen  as  thay  are  pronst^ted 
in  pay  grade  from  striker  to  petty  officer  second 

clans. 

5.  The  Matrel  attitadee  of  electroaiea  techniciaca, 

as  e^reaaed  in  a  self-report  qseettonaalre.  gen¬ 
erally  are  not  etroegly  related  to  technical  fleet 
proflclenoy.  although  attitadee  mgsrdiac  cer  iaia 
aspects  of  the  job  migr  bare  alight,  positire  re- 
latioa^kipa  with  teclmical  proAciaacy. 

i.  The  measured  fleet  effectireaeee  of  riectroclcs 
tecbnlciaaa  is  not  related  to  scores  oa  the  If  nry 
Basic  Teat  Battery  or  to  tecbaieal  school  gitidea. 
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As  a  result  of  three  Applied  Paycholc^cal  Services'  ^udies.  it 
seems  reasonable  to  state  that  technical  skills  involved  in  Ne/al  ratings 
are  scalable  in  the  same  manner  as  attitudes  and  die  sensory  phenomena 
which  have  been  previously  scaled  psychophysicaUy  and  that  the  scaling 
can  be  establiahed  either  within  a  single  rating  or  across  several  related 
ratings.  The  scales  a|g»ear  to  offsr  s  quick,  convenient  wi^  oi  evsltmUng 
the  poat-trainiQg  technical  proficiency  of  Nav:d  personnel  snil  to  provide 
one  basis  for  judging  the  effectivenese  of  technical  training  programs. 
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APPMtMX  A 

Appendix  A  presents  die  prellmtnxrjr  tssk  list. 

I 

I 

I 

I 

I 

I 

B 

I 

I 

I  -*i- 

I 


Yoar  Name 
Rate 

Kuosber  of  years  in  rate 

Squadron 

IfOeation 


PrefMured  by 

Applied  PpycfatRcflcal  Serrlcee 
Wayne,  Pm, 
oader 

Contract  lfonr-tS79(00) 
wltb  the 


Office  of  Naval  Research 
Aagnst  ItSb 


DIRECTIONS 


Listed  below  you  will  find  28  taska  that  are  doa^  oy  strikers  n 
youi-  raiin'?.  Read  over  the  28  taska  sikI  then  taaiag  the  r.  below  s.i 
a  cuido  iiiiicate  tha  decree  of  diffieiilty  you  believe  that  i  ;a  typical 
staikas-  eacGualerc  oa  each  of  the  tasks  befbro  be  caa  ps;.  .'orm  it  pro- 
ucieiiUy.  These  judgments  are  to  be  xnade  in  the  follow;  ag  maaoer: 


1  i  3 

CAsy 

AVtIIMK  MOUNT 

wtat  Mfr 

1 .  Usu^  the  sUckere  provided  place  the  sticker  wit  .  a  ^  on  it 
neat  to  the  job  that  is  least  difficult  for  the  evers je  striker. 

2.  Then  pick  the  fiuree  jobs  that  fall  in  category  and  put 
the  three  stickers  with  2'e  oa  them  Mxt  to  these  Uems. 


3.  Now  find  the  job  that  is  the  most  difficult  and  pis js  the  etietei 
with  the  7^  on  it  next  to  this  item. 

4.  Fiixl  the  three  items  jrou  went  to  place  in  f  **six'*  and 

put  these  stickers  next  to  these  tikree  items. 


Now  with  die  tasks  remaining  place  them  in  tiMir  propmr  cat¬ 
egory  by  puttieg  the  sticker  (i.  e. .  J.  4.  or  £)  wi  h  the  category 
number  next  to  the  items.  —  ~  — 
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JOB  ASSIGNMENTS 


SCALE  VALUE 


1.  C^erating 


2.  Prellight  inspecting 

3.  Postflight  ln^;»ecting  1 

1 

% 

5 .  Periodically  inspecting 

1 

1 

8.  Maintainii^ 

i 

!. 

1  7.  Removirg  I 

6.  Rmiring 

5 

1 

9.  Replacing 

i 

1 

10.  Performing  preventatlye  maintenance 

11.  Trouble  rtiootii^/iaolating  malfunctioo(s)  in 

12.  Calibraiiiv 

13.  Aligning 

17.  Employing  safety  precauticms  on  I 

19.  Making  out  failure  reports  for 

20.  Using  manuals  of  a  technical  nature  for 

JOB  ASSIQlfirSlfTS 

SCAUE  VAI.UE 

21.  Using  appropriate  test  equipment  for  determinii^ 
maUtmctions  in  the 

33.  Usine  ASO  catatocue  for  replaceoaent  parte  for 

W  A  *  ^ <  -a-;  a  :■  ■  1  -i  ■  ■ :  <  ■  \  a  1-a-i  ■  •  m j  '..i 

IfiPPiPPPiPPPPPP^^^^^H 

27.  IfistmctiQC  odiera  in  maintenance  of 

38.  Inetmctine  othere  in  the  inspection  of 

Check  to  make  sure  that  you  have  answered  every  <|uestl<Mii. 


I 


5ft 


Name  of  man  you  are  evaluating 
Rate 


Squadron 

Location 

Your  Name  and  Rate 

Hunger  of  months  you  have  siq>ervtsed  man  you  are  evaloatlnc 


SCALED  TECHNICAL  PEOFICIBNCY 
CHECK  LIST 


Prepared  by 

Applied  PsyclKdoglcal  Services 
Wayne,  Pa. 
under 

Contract  Nonr-337P<00) 
with  the 

Office  of  Naval  Research 
August  1959 


DIRECTIONS 


For  each  of  the  task*  lieted  indicate  (by  placing  a  chec.4  mark  in 
the  sf^rcpriate  column)  whether  or  not  the  man  you  are  evaluating  hae 
been  checks  out  aa  being  proficUat  (i.  e. .  ia  ha  capable  of  doing  the 
task  "on  hla  cma**  without  direct  auperviaion?)  If  the  man  yoo  are  rating 
hae  not  been  checked  out  aa  being  proficient  on  a  taak.  becau£3  he  haa  not 
worked  on  thia  tank,  thia  ahould  be  indicated  b"  a  check  mark  in  the  third 
column. 

gaamplea; 

1.  If  the  man  haa  been  checked  out  on  a  taak  place  a  chec4  mark  {/) 
in  col'omn  one  <1). 

2.  If  he  haa  not  been  checked  out  aa  being  protteient  but  haa  actually 
worked  onT^iia  taak  place  a  check  mark  tA  in  colunm  two  (I). 

3.  If  he  haa  not  been  checked  out  aa  being  proficient  becauae  be  haa 
not  performed  thia  taak,  place  a  check  mark  (A  in  colunm 
three  (S)  next  to  the  appropriate  item. 

Be  aura  that  you  give  an  anawer  for  every  taak  that  ie  Uated.  You 
may  not  be  certain  about  aome  itema,  but  anawer  every  item  on  the  baaia 
of  what  ^;>peara  to  be  the  moat  Marly  correct  anawer  for  the  man  you  are 
rating. 
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2.  Freflight  intpecting 

3.  Riatllight  iniNjectlng 


4.  Inflltfiit  IntpecUng 

5.  Portodically  iiMp«ctiQg 
g.  Itelatainlqg 

7.  Removing 

8.  Repoiring 
9«  Replacing 

10.  Performliw  provotatlv  mtinfiMunce 

11.  Trouble  obootlng / loolotlqg  m>ifimcttoo<»)  In 


12.  Calibrating 


14.  FoUawlng  block  dUgraaw  for 

15,  Uotcw  «taod«rd  •ch«mgtlc«  for 
18.  AmUiyKlni  otmdard  circuitry  in 

17.  gaiploylM  safty  pfcutiont  on 

18.  Uminm  proper  — fty  i>roc«ttUoti«  for  whtii  worlifaig  on 
18,  Making  out  ftiilw  roportg  for 


30.  romuftlt  of  >  ttchnlc^l  notwro  for 
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